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Abstract 

We establish a Large Deviations Principle for stochastic processes with 
Lipschitz continuous oblique reflections on regular domains. The rate 
functional is given as the value function of a control problem and is proved 
to be good. The proof is based on an original viscosity solution approach. 
The idea consists in interpreting the probabilities as the solutions of some 
PDEs, make the logarithmic transform, pass to the limit, and then identify 
the action functional as the solution of the limiting equation. 
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1 Introduction 

According to the terminology of Varadhan [46], a sequence [X^) of random vari- 
ables with values in a metric space {X,d) satisfies a Large Deviations Principle 
(LDP in short) if 

There exists a lower semi- continuous functional A : A" — )• [0, oo] such that for 
each Borel measurable set Q of X 

(I) limsup{-e2lnP[X*'^'^ e G]) < inf Xt xig) (LDP's upper bound), 
(II) inf At x{g) < liminf {-e^ In P[X*^^^^ e ^^]| (LDP's lower bound), 
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A is called the rate functional for the large Deviations principle (LDP). A rate 
functional is good if for any a € [0,oo), the set {g € X : A(.g) < a} is compact. 

We refer the reder to the books [J, [32], [SU], [S], E] for the 

general theory, references and different approches to Large Deviations. 

Partial Differential Equations (in short PDEs) methods have been applied to 
establish different types of Large Deviations estimates starting from [27]. The 
idea consists in interpreting the probabilities as the solutions of some PDEs, 
make the logarithmic transform, pass to the limit, and then identify the action 
functional as the solution of the limiting equation. The notion of viscosity 
solutions (cf. [TS], [35]- [55], [H]) appeared to be particularly adapted to this 
problem. Indeed, the half-relaxed semi-limit method (cf. [^) allows to pass 
to the limit very easily, moreover the notion of strong uniqueness for viscosity 
solution allows to identify the solution of the limiting equation with the action 
functional. A number of Large Deviations results have been proved by using 
this method [22] , [55] , [5] , [TU] , [S] , [3] , [S] . However it was a long lasting critic 
to this method not to provide the general Large Deviations Principle. The aim 
of this work was to overcome this gap. We carry out this method in order to 
establish a LDP for small diffusions with oblique Lipischitz continuous direction 
of reflections which explains the technicity. This result is new to the best of our 
knowledge. Our method which was developed in [3S], seems very efficient and 
we hope it gives a new insight. 

Recently [25] came to our knowledge. This book shows also, in a very general 
setting, that viscosity solutions are an adapted tool in order to establish LDPs. 

To be more specific we introduce the precise mathematical formulation of 
the problem. 

Let C be a smooth open bounded subset of M^. For (t, x) e iR+ x O, we 
consider the oblique reflection problem 

dXs ^ b{s,Xs)ds -dks, X, e O (Vs > t), 

r (1) 

= / \ao{X,h{X,)d\k\r (Vs > i), Xt = X. 
Jt 

where & is a continuous iR''-valued function defined on x O and 7 is a 
K'^-vector field defined on dO. The solutions of problem (jlj are pairs {X, k) 
of continuous functions from [t, 00) to O and M"^ respectively such that k has 
bounded variations, and |fc| denotes the total variation of k. 

We shall denote by n{x) the unit outward normal to dO at x, and assume 
that 

7 : M"^ M'^ is a Lipschitz continuous function 

(2) 

and 3co Vx e dO, j{x) ■ n{x) > cq > 0. 

When b is Lipschitz continuous, 7 satisfies condition ^ and O is smooth, 
the existence of the solutions of (HJ is given as a particular case of the results of 
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Lions and Sznitman [33] and the uniqueness is a corollary of the result of Barles 
and Lions ffl. For more general domains existence and uniqueness of solutions 
of (HI) is given as a particular case of Dupuis and Ishii [31] . The reader can also 
use the results given in Appendix B. 

Let (51, J- ^ {J't)t>Oj P) be a probability space which satisfies the usual condi- 
tions and {Wt)t>o be a standard Brownian motion with values in K™. Consider 
for each e > 0, t > 0, x G O, the following stochastic differential equation 

dXI = 6e(s, Xl)ds + eCTe(s, XI)dWs - dkl, {ys>t), 

kl= [ l90{X'r)l{X'r)d\k'\r (Vs > t), XI = X, 

Jt 

where a is continuous iR'*^™-valued. A strong solution of ([3]) is a couple 
(X|,fcj)s>t of (J%j)s>i-adapted processes which have almost surely continuous 
paths and such that {kf)s>t has almost surely bounded variations, and \k^\ 
denotes its total variation. 

Let us now make some comments about this reflection problem. Consider 
equation ([3]) in the case when e = 1. 

This type of stochastic differential equations has been solved by using the 
Skorokhod map by Lions and Sznitman in |39j in the case when O belongs to a 
very large class of admissible open subsets and the direction of reflection is the 
normal direction n, or when O is smooth and 7 is of class C^. This problem was 
also deeply studied by Dupuis and Ishii [19] , [20] , [21] . When O is convex these 
authors proved in |19j that the Skorokhod map is Lipschitz continuous even 
when trajectories may have jumps. As a corollary, this result gives existence 
and uniqueness of the solution of the stochastic equation (jSJ) and provides the 
Large Deviations estimates as well. Dupuis and Ishii also proved in [21] the 
existence of the solution of equation ([3]) in the following cases: either 7 is 
and O has only an exterior cone condition, or C is a finite intersection of 
regular bounded domains Oi and 7 is Lipschitz continuous at points x e dO 
when X belongs to only one dOi but when x is a corner point, 7(2;) can even 
be multivaluated. A key ingredient is the use of test functions that Dupuis and 
Ishii build in [18] , [31] and [20] in order to study oblique derivative problems for 
fully nonlinear second-order elliptic PDEs on nonsmooth domains. 

Let us point out that these type of diffusions with oblique refiection in do- 
mains with corners arise as rescaled queueing networks and related systems with 
feedback (see [3] and the references within). 

We study in the present paper Large Deviations of ^ under the simpler 
condition of a domain without corners. More precisely we suppose that 

O is a Qpgj^ bounded set of M^. (4) 
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Let us precise now what is the regularity we require on the coefficients b, a 
and &£, Ge and how be and tTe are supposed to converge to b and a. 

For all £ > 0, let 6^, 6 € C([0, +00) x O; 1?''), CTe,CT G C([0,+oo) xO; M^""""). 
And assume that for each T > 0, there exists a constant Ct such that for all 
e > 0, for ah t G [0, T], for all x,x' eO one has 

\b{t,x)-b{t,X% \be(t,x)-hS,x')\<CT\x-x'l , . 

\\a{t,x)-a{t,x')\l \\aS.x)-<jS,x')\\<CT\x-x'\. 

We also assume that 

(cte) converge uniformly to b and cr on [0,T] x C (6) 

By [21] for all £ > and for all G [0,r] x O, there exists a unique 

solution (X*'^'^, fc*'^'"^) of ([3]) on [t^T]. Morever X*'^''^ converges in probability 
to the solution X*'^ of ([T]) when £ converges to 0. Obtaining the Large Deviations 
estimates provides the rate of this convergence. 

We now turn to the definition of the rate functional A. It is defined under 
conditions ([2])-(|3])-(l5]) as the value function of a non standard contole problem 
of a deterministic differential equation with coefficients and with oblique 
reflections. 

More precisely, let {t,x) G [0,r] x O and a G L'^{t,T; R""-) and consider 
equation 

' dY, = {b{s,Y,)-a{s,Ys)a,)ds-dz„ G O, (Vs > t), 

r (7) 

= / loo{Yrh{Yr)d\z\r,{Vs>t), Yt^X. 
Jt 

We prove in Appendix B that there exists a unique solution (F^*'^'", 7-] 
of (O, and we study the regularity of Y with respect to t, x, a and s. 



In the following we note 

X =Ci[0,T];O) and for 5 G A-, |l.g|U = sup \g{x)\. 

te[o,T] 

We make the following abuse of notations. For Q <Z X and for g G C{[t,T]\0) 
for some t G [0, T], we write g £ Q if there exists a function in Q whose restriction 
to [t^T] coincides with g. 



For all 5 G A", we define \t,x{g) by 

MAg) = I ^ ^ \o^s?ds- a G L\t, T), F*^-'" ^g). (8) 



Note that XtAd) G [O1 +°°\- 
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The main result of our paper is the proof of the fuh Large Deviations type 
estimates for ([3]), as well as the identification of the rate functional which is 
proved to be good. 

Theorem 1.1 Assume For each {t,x) e [0,T] x O, and e > 0, 

denote by X*'^'^ the unique solution of 0^ on [t^T]. Consider Xt^x defined by 
Then (X*'^'^)^ satisfies a Large Deviations Principle with rate functional 
Xt.x- Moreover the rate functional is good. 

As far as the partial differential equations are concerned, we use the notion 
of viscosity solutions. We shall not recall the classical results of the theory of 
viscosity solutions here and we refer the reader to M.G. Crandall, H. Ishii and P.- 
L. Lions [14 (Section 7 for viscosity solutions of second order Hamilton-Jacobi 
equations), to W.H. Fleming and H.M. Soner [29] (Chapter 5 for stochastic 
controlled processes) and to G. Barles [4 (Chapter 4 for viscosity solutions of 
first order Hamilton-Jacobi equations with Neumann type boundary conditions 
and Chapter 5 Section 2 for deterministic controlled processes with reflections). 

The paper is organised as follows. In section 2, we prove first that assertion 
(I) amounts to the proof of this upper bound for a ball B (assertion (Al)). 
Second, we prove that if the rate is good, assertion (II) amounts to prove the 
lower bound for a finit intersection of complementaries of balls (assertion (A2)). 
Finally, we prove that the fact that the rate is good holds true if a stability 
result holds true for equation ([7]) (assertion (A3)). In section 3, we give the 
proof of (Al), and we finish in section 4 by the proof of (A2). 

An important Appendix follows. It includes, in Appendix B, the study of 
equation ([7]) and the proof of (A3). In Appendix C, we study different mixed 
optimal control-optimal single or multiple stopping times problems and we car- 
acterize particular value functions as the minimal (resp. maximal) viscosity 
supersolution (resp. subsolution) of the related obstacle problems. These car- 
acterizations are important in order to establish (Al) and (A2). Eventually, in 
Appendix D, we prove a strong comparison result for viscosity solutions of an 
obstacle problem with Neumann boundary conditions and quadratic growth in 
the gradient in the case of a continuous obstacle. This result is needed in the 
proof of the caracterization of the value functions mentioned above. This long 
and technical Appendix begins in Appendix A, by the construction of an appro- 
priate test function which is usefuU in order to establish the results concerning 
equation ([7|) (Appendix B) and the uniqueness result (Appendix D). 
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2 A preliminary result 



Wc now define the action functional. For each. {t,x) £ [0,T] x O, and for each 
Q C X let us define At.x{G) as follows: 



(9) 



where F*-^'" is defined by ©. 

It is straightforward that At^x is decreasing along increasing sequences of 
sets and that 

At.xiG) = inf Xt.xig) and Xt,x{g) = At.xHg})- 
geg 

We use the following notation: for £ X and r > we denote by B{go,r) the 
ball of center go and of radius r that is B{gQ, r) — {g £ X, \\g — golloo < ''I- 

We consider the following assertions. 

(Al) for all g e X, and r > 0, 

\imsnp{^eHnP[X''-'' G B{g,r)]} < At,,(S(.g, r)), 

(A2) for all i e W, gi e X, and > 0, setting Bi — B{gi,ri), one has for all 



liminf <^ -e^lnP 



N 



(A3) for all a„,a e L2(0,r;iR'"), 

if an a weakly in then Hr*'^^"- - 



AT 



0. 



The following proposition shows that Theorem I 1 . 1 [ reduces to assertions (Al), 
(A2) and (A3). 

Proposition 2.1 For all {t,x) e [0,T] x O one has, 

(i) (Al) implies (I), 

(ii) If the rate is good then (A2) implies (II). 

(Hi) (A3) implies that the rate functional Xt^x defined by 0^ is good. 
In particular, the proof of Theorem \1.1\ amounts to the proofs of (Al), (A2), 
(A3). 

Proof: First let us prove (i). 

Consider a measurable set Q <Z X. For all 5 € Q, there exists r > such 
that B{g,r)cig. Then 

-e^inpfx*'^'-^ eg]< -£2inP[J5(:*'^''^ e g] < -e2lnP[X*'^''^ G B{g,r)]. 
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Hence, by (Al) we obtain 

linisup{-£2lnP[X*'"=''^ e G]} < limsup{-e2lnP[X*^^^'^ G I3{g,r)]} 

E^O e-s-0 

<AtA'3{9,r))<XtA9), 

and we conclude by taking the infimum over all 5 G CJ. This completes the proof 
of point (i). 

Let us prove (ii). 

Fix a < At.xiQ) and put IC ^ {g e C{[t,T];0), Xt,x{g) < a}. Note that 
At,2;(/C'^) > a. One also clearly has K, C G , indeed ii g E K, one has \t,x{g) < a 
and \i g & Q then \t,x{g) > a hence /C n O = 0. As a concequence, for all g & IC, 
there exists r > such that B{g,r) C G ■ Since, by (T2), JC is compact, there 
exists a finite number N oi Bi — B{gi,ri) with gi £ K, and > 0, such that 

N 

/C C [J C tj'^. In view of the fact that At^^; is decreasing along increasing 

i=l 

sequences of sets, this yields, passing to the complementaries that 

N 

At, ' 



■..X i^Y'i^ > At,,(/C^) > a. 



It is clear that 



liminf l-e^ InP [X*'^'" e ^1 1 > liminf <^ -e^ InP 



AT 



But, by (A3) we also have 



liminf <^ -eMnP 

e-»-0 



N 



X 



t,X,€ 



N 



> Am n Bt 



hence we have shown that for all a < At^x{G), we have 

liminf {-e^ InP [A*'"^'^ e G]} > a. 

Passing to the limit when a tends to At x{G), we have completed the proof of 
(ii). 



Let us prove (iii). 

We suppose that the rate functional Xt,x defined by ([8]) satisfies (A3). Fix 
{t, x) G [0, T] X O, and a £ M. Put IC = {g £ X , \t,x{g) < a}- Let {gn)neiN be a 
sequence of /C. Then, for all n, there exists Q!„ G L'^{t, T) such that = 
and 

1 /"^ 

|a„(s)p(is < a + 0(1) [n— 7>oo]. 
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Thus (an)ngjv is bounded in L'^{t, T) and extracting a subsequence if necessary, 
one can suppose that the sequence (a„)„gjv converges weakly in T) to some 
a e L'^{t,T). By (A2), (y*'^'"")„ converges uniformly on [t,T] to F*^"^'" and 
since for all n, Y*'^'°'" = .g„ the sequence {gn)neiN converges to some g — Y^'^'" 
in X. Moreover, 

Ai.x(g) < t: / ISspds < liminf - / |a„(s)pds < a, 

hence 5 € /C. We have proved that /C is compact, and the proof of point (iii) is 
complete. o 

3 Proof of assertion (Al) 

Fix go £ X and r > and consider the ball B{go,r). The aim of this sec- 
tion is to prove that for each {t,x) G [0,T] x O, the probability Ue{t,x) de- 
fined by Ue{t,x) = p[X*'^''^ e ,B((/o,?')] satisfies limsup {— lnMe(t, x)} < 

At,,{B{go,r)). 

Step 1. From a probability to a PDE 

We first interpret the probability Ug{t,x) as the value function of an optimal 
stopping problem. 

Let us define the tube B as the set 

B = {{t, x) e [0, T] xO,\x- 50 Wl < r}. (10) 



Proposition 3.1 Ue(t,x) is the value function of the following optimal stopping 
problem 

uAt,x)= inlE[lj,i0,Xl'^^% 

where Tt is the set of stopping times 6 with value in [t,T]. 

The proof can be found at the end of this section. 

We now recall that the value function of an optimal stopping time problem 
is a viscosity solution of a variational inequality. 

More precisely for each bounded Borel function -0 on [0,r] x M'^ consider 

uMit,x)^ MEme,xl'^n], (11) 



where X*'^'^ is the solution of then U^IiIj] is a sohition of 

(12) 



max + 'Ceti, u-tP] = in [0, T) X O 



— = in [0,r) X do, uiT) = i;{T) on O. 
07 
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^2 

where LeU — — ^Tr[(Te(T^ D'^u] — ■ Du. 

Proposition 3.2 Assume and {Jj. Then the Junction U^[^] defined by 

(QTp is a viscosity solution of 



This resuh is a standard consequence of the well-known Dynamic Programming 
Principle. Under regularity conditions the proof goes back to [7]. For a general 
proof of the Dynamic Programming Principle see 24 or lllj . 



This gives that = J7e[lB] is a solution of the variational inequality (|12p 
with obstacle 1b- 

Step 2. The logarithmic transform 

For all function -0 nonnegative and bounded away from 0, let 14 [t/"] be defined 

by 

vM^-e^HUM)- (13) 

Then [■0] is a viscosity solution of the following the variational inequality with 
obstacle h\{tl)) 



(14) 



Ox r \ 

— + H,{D''V,DV),V ~ e'^H^ = in [0,r)xO, 

f)y 

— = in [0,r) X do, ViT) = e"^ InmT)) on O, 

where H^{D^V,DV) = -^Tiia^aJ D^V] + ^\ajDV\^- b^ ■ DV. 

Formaly, '■= — In(Me) — V^[1b] is a viscosity solution of variational 
inequality (fM)) with singular obstacle xb'^ = — £^ In(lB) defined by 



XB>=(a;) 



00 if a; G B'^, 
if a; G B. 



In order to avoid the singularity, we seek now to approximate the original 
obstacle 1b in such a way that after the logarithmic transform, the obstacle 
becomes A1b<= with A> 0. We define for all A, e > 0, the real valued functions 

ip^, and vf by 

= exp(-AlBc/£2), = U[i}f] and vf = V[il^f]. (15) 

Note that t/'^ > 1b, hence > and < v^. As our aim is to majorate 
lim sup Ve, it seems at first that we have the inequality from the wrong side. 
However, the following lemma shows that we can reduce ourselves to the study 
of vf. 

Lemma 3.3 For all A> 0, and for all {t,x) G [0,T] x O, we have 

lim sup = lim sup A A. 
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The proof can be found at the end of this section. 

Clearly is a viscosity solution of variational inequality with obstacle 

Step 3. Passing to the limit 

When £ goes to 0, equation ([H)) with obstacle Al^c converges to the following 
variational inequality with obstacle AIb" 

minf-— + -|cr^Dt)|2-6.Dt;,t;-AlBo j =Oin [0,r) x O, 

B - ^^^^ 

= in [0,T) X do, v(T) = AIboIT) on O. 

By a general stability result for viscosity solutions (see [4 or [B]), the half- 
relaxed upper-limit limsup* defined for all {t,x) in [0,r] x O by 

limsup* w^(t, a;) = limsup v^{s,y). 
is a viscosity subsolution of the limit equation (jl6p . 

Step 4. A first order mixed optimal control-optimal stop- 
ping problem: back to the action functional 

We now study a value function of a mixed optimal control-optimal stopping 
problem which appears to be the maximal viscosity subsolution of equation 
(fT6)) . and which we compare with At^xiB). 

For each bounded Borel function ip, and for all {t, x) E [0, T] x O, define the 
following value function 

vmt,x)= mf sup \l f \a,\^ds + ijieX'^'")\ (17) 

aeL^{t,T) g^[t,T] Jt J 

where y*'^'" is the unique solution of 

Proposition 3.4 1. For each bounded Borel function ijj the function v[ip*\ 
defined by |J7p is the maximal use viscosity subsolution of the variational 
inequality hl&jl with obstacle tp. 

2. For allA> 0, {t,x) G [0,r] x O, one has v[AlBo]{t,x) < AA At,^(6). 

The proof can be found in Appendix C for point (1.) and at the end of this 
section for point (2.). 
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Conclusion 

By Lemma 13.31 by using the half-reaxed semi-limit method, and by Proposition 
[311] (1) and (2), we have, for each A> 0, 

A Alimsup {-e'^ lnue{t, x)} < hmsup*w^(t, x) < -u[A1bc] < AAAt,x{B). 

As the inequahty holds for all A > 0, and proof of (Al) is complete, o 
We now turn to the proofs of Propositions 13.11 13.41 and Lemma 13.31 
Proof of Proposition \3.1l ' 

Obviously, if X*'^^'^ e B then (e',X*'"='^) e B for aU 9 e Tt, hence Ueit,x) < 
E[lBi0,Xl''''')]. Taking the infimum over 9 e Tt we obtain 

u,{t,x) < inf ^[1b(0,X*^"'")]. 

9eTt ail 

Conversely, let Q be the first exit time of (s, X*^^'^)^^^^ 7-] from B 
0~ = inf{,s>i, |X*'-^^-.go(s)| >r}. 

Then A T is a stopping time which takes value in [t,T]. Let us show that 
almost surely 

{(BatXC:^) e B} c {x'-^-^ e B}. 

Indeed, suppose (^(w)AT,X~'^'^^^^) e B, then > T. Hence for all s £ [t,T] 

we have \Xl'^'^{uj) — go(s)\ < r, which means, as both and (7o(.) are 

continuous on [t,T] that \\X*'^'^{uj) — (/oiloo < r, hence e B and the 

proof is complete, o 

Proof of Lemma W^ 

Fix e [0,T] X O, and A > 0. Clearly e"^/^' V lB(i,a;) < < 

1b (i, a;) + e~^^^ . This gives easily, 

e"^/^' V Ue (i , x) < {t,x) < Ue (i , x) + e"^/^' . 
As for any nonegative sequence (ug) one has 

limsup I — ln(M£ + e~'^/^ ) I = A A limsup {— InUg} , we obtain 

A A limsup {— In Me} > limsup {~£^ Inw^} > A A limsup {— £^ Inu^} , 
which completes the proof of the lemma, o 
Proof of Proposition \3.4\ 

Point (1) is detailed in Appendix C (Proposition 15. 8p . 
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Let us prove now the second point. Obviously, v^{t,x) < A. Now, if 
^t,x{B) < A, for each 77 > such that At,x{B) + rj < A there exists a S 
L^it, T) such that F*-^^" e 6 and 

Thus, for any G [t,T], one has IwidTYg'^'") = so that 

v'^{t,x)= inf sup- / |a,pds<-/ {a^l^ds < At,^iB) + tj. 

QGL2(t,T) e£[t,T] ^ Jt ^ Jt 

We have proved that < A A At.x{B). o 



4 Proof of assertion (A2) 

Let {gn)n£]N be a sequence of functions in X and (r„)„giv, a sequence of positive 
reals. For each nonempty finit subset I oi IN and for all (t, a;) £ [0, T] x O, we 
define 

ui{t,x) = P[X''^'' eg], where g = p|B(5„r,)^ (18) 

iei 

and we prove that liminf \ —e^\nui{t,x)\ > At.x{G)- 

In the following we will denote by 9i a multiple stopping time {9i)i^i with 
9i E Tt for each i e /, and we write 6*/ G T/. 



Step 1. Prom a probability to a PDE 

We first interpret ul{t,x) as the value of an optimal multiple stopping times 
problem. 

Proposition 4.1 For all {t,x) E [0,T] x O, for all e > 0, and for each finit 
nonempty subset I of IN 



ul{t, x) = sup E 



t,x,e 



)) 



.iei 



where for all i E I, B; = E [0,T] x O; \x - gi{t)\ < rJ. 



Proof: It is similar to the proof of Proposition 13.11 The main difference is in 
the choice of the optimal stopping time which is here 9j E T/ where for i E I, 
9i is the first exit time in [t,T] of (s,X*'^''^) from B^. o 



As by the logarithmic transform the obstacles would take there values in 
[0,00], the first task is to approximate Ib-?- For all A,£>0 and for all i E IN, 
we define 

^1b, 



exp 



(19) 
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Note that for all £ > we have Ib^^ < ^pl'^. 

We define for each nonempty finit subset / of IV, for each A,e > 0, and each 
{t,x) G [0, T] X O the value function 



u['^{t, x) = sup E 



(20) 



Clearly 

ui{t,x) Kui^'^it^x). (21) 

We now proceed to the reduction of the multiple stopping problem to a 
single stopping problem. More precisely let us define for all finit subset I oi IN 
containing two or more elements, for all A, e > 0, and for all (f, x) G [0, T] x O, 

V'f '^(i, x) = max U^^'^^it, x)u[\^'^-^[t, x)] . 

One has by Theorem 3.1 in [33] 

ui'^{t,x) = supE[i;i^^{e,Xl'^n]- 

Now, one can show (cf _11,) that ul'^ is a viscosity subsolution of the following 
variational inequality 

min (^-^ + ^eu, u - V4"^^ = in [0, T) x O, 
1^ = in [0,r) X aO, u{T) = Ve'^(T') on O. 
Step 2. The logarithmic transform 

For all nonempty finit subset / of iV, for all v4, e > 0, let v\'^ be defined on 
[0,T] X O by 

z;,^'^ = -£2ij^^/,a_ ^22) 
Then v^^'^ is a viscosity supersolution of the following variational inequality 

+ H^{p'^v,Dv),v - ^^^^ =Oin [0,T) x O 

^ in [0, T) X 90, w(T) = (/)^"^ (T) on O 

where, for all nonempty finit subset I oi IN, for all A,£ > 0, 

AIb, if / = {i} with i G JV, 

mm {aIb. + if card/ > 2. ^^^^ 
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Step 3. A mixed optimal control-optimal multiple stopping 
problem 

Let us turn now to the study of a mixed optimal control-optimal multiple stop- 
ping problem. The value function of this problem will be shown to be smaller 
than the half-relaxed lower limit lim* v^''^{t,x) and greater than At,x{G) A A. 

For all finit and nonempty subset I oi IN and for all {t, x) E [0, T] x O, define 
the following value function 



\as\"ds + 

where Y*'^'" is the unique solution of 



This mixed optimal multiple stopping problem can be reduced to a mixed 
optimal single stopping problem. More precisely, consider for each bounded real 
valued measurable cj) defined on [0,T] x O and for each {t,x) £ [0,T] x O the 
following value function 

vmt,x) - inf _ inf^, 1 i r \as\^ds + cPieX'""'") \ , (25) 



QeL2(t,T) 0e[t,T] I 2 
where y*'^'" is the unique solution of 

Define also for all nonempty finit subset I oi IN, for all A > 0, 



kl.A 



AIb, if / = {i} with i e 

mm I Ale, + if card I > 2. ^^^^ 



Proposition 4.2 Let I be a finit subset of IN and A > Q, and consider the 
function v^'^ defined by {24^ . Then 

1. for each {t,x) e [0,r] x O one has v^'^{t,x) = v[(l)^'^]{t,x) where cf)^'^ is 
defined by i26\) . 

2. one has for all {t,x) E [0,T] x O, v^'^{t,x) > AAAt,x{G)- 

Proof: The proof of (1) is the concequence of a reduction result for optimal 
multiple stopping problems. It is detailed in Appendix C (Proposition 15.91) . 
Let us prove (2). Suppose v-''^{t,x) < A, then for each 77 > such that 
v''^(t, x)+r] < A, there exists 6*/ € [0, T]^ and a G L'^{t, T) such that 

\ T"''' + VA1b,(0.,F,*.'"'") < v'^^{t,x)+r^< A. 

This means in particular that {Oi,Yg"^'°') e for all i G / and therefore 

. ^ f as if s < 

1^ otherwise. 
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Then again Y*-^-" G Q and 

K'AQ)<\j^ \as\''ds<v'^^{t,x)+ii 

and letting 77 to the proof is complete, o 

We now give some results concerning the mixed optimal single stopping 
problem ()25|) . and its links with the following variational inequality: 



max f + -\a'^Dv\^ ~b-Dv,v-cj) \ = in [0,r) x O 

3 _ ^^^^ 

in [0,T) X do, v{T) ^ (l){T) on O 

07 

Proposition 4.3 Let : [0, T] x O 6e a measurable, bounded, real valued Junc- 
tion then the function is the minimal Isc viscosity supersolution of the 
variational inequality |ii7[ ). 



The proof is similar and even simpler than the proof of Proposition [521 Let us 
remark that this result is well known for deterministic systems with Lipschitz 
coefficients in JR" (see Barles and Perthame [S]). The main difficulty in the 
present case is to prove the minimality of v[(j),^]. This point is the concequence 
of a strong comparison result for equation ([27]) when the obstacle is bounded 
and continuous on [0, T] x O. The proof of this strong comparison result, which 
is highly technical, is detailed in Appendix D. 

Step 4. Passing to the limit 

Let us now prove the following lemma 

Lemma 4.4 For each finit non-empty subset I of IN and for each A> 0, one 
has 

liminf, vy{t,x) > v[(l)^'^]{t,x). 

Proof: The result is established by induction on the cardinal of /. If / = {i} 
for some i in IN, then liminf* Ve^^'^ is a viscosity supersolution of (l?fl) with 
(j) = ^'t*!'^. By Proposition 14.31 is the minimal viscosity supersolution 

of the same equation, hence the proof is complete. 

Suppose now that / has N elements with N > 2 and that the lemma holds 
for any subset J of IN* containing A^ — 1 elements. Then by using the induction 
hypothesis on formula (|26)) . one has liminf*^^^"^ — <f>^'^ > (j)^'^. By a stabil- 
ity result liminf»w^'"^ is a viscosity supersolution of (|27|) with obstacle cj)^'^. 
By Proposition 14. 3| as t^^'^ is Isc, the minimal viscosity supersolution of this 
equation is v[4i^'^]. Now as (f)^'^ > (p^'^ one clearly has v[(f)^'^] > v[(l)^'^]. 

Finally we have liminf* v^'^ > v[4>-''^] > v^'^ which completes the proof of 
the lemma. o 
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Conclusion 

For all finit nonempty subset / of N, for all A> 0, and for all {t, x) e [0, T]xO 
one has, by inequality (pTt . ul{t,x) < ul'^{t,x), hence, by Lemma and by 
Proposition [ 



limAnf {-e^\nui{t,x)} > liminf* ^^"^(t, x) > t;[(/)^'^](i, x) > At,^(g) A A. 
The proof of (A3) is complete. o 

5 Appendix 

Appendix A: the test-function 

Lemma 5.1 We assume that 7 and O satisfy (0j and Then, for all e, p > 
0, there exists Tp^^p G C^{0 x 0,IR) such that, 



(ipii) 



I 1 2 2 

Vx,yeo, \D,,p,A^,y)\ + \Dy^eA^,y)\< K{^-^^ + 



(ipiii) 



yxedO,yeO, D.,^p,Ax,y) ■ -/(x) > 0, 
\fyedO,xeO, Dy^,Ax,y)--f{y)>0. 

for some constant K depending only on O, II7II00 HtHlip and Cq. 



We use ideas from [5]. 
Proof: We first define the Lipschitz continuous JR''-valued function /i on dO 

by 

J(X) ■ n(x) 

as well as its smooth approximation (/ip)p>o such that for all p > 0, Pp G 

IIa'pII + II^a'pII <Ki 

for some constant Ki > independent of p and for all x G dO 

\pp{x) - p{x)\ < p. 

Then we set, 

, . ^ _ k-yP , o {x-y) ^ x + y ^ {d{x)-^d{y)) ^ ^{d{x) - d{y)f 

9e,p(X,y) — 2 ^ ' Pp{ — 7] — ) — 
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Wc can choose the constant ^ > large enough in order to get, for some 
constant > and for all e, p > 0, 



{(j)n) < 



yx,y€ O, \D^(j)e,p{x,y)\ + \Dy<PeAx,y)\ < K2 



x-y\ 



I |2 2 

VxGaO,2/GO, i),</,,,^(x,y)-7(:r) >-if2[^^ + ^], 

I 1 2 2 

Vy e e Dy^,A^,y) ■ j{y) > -i^^f^^ + 

Indeed comes from a simple application of Cauchy-Schwarz inequality, 
and from the fact that d is Lipschitz continuous. Now for all U = {u,v) G 
M'^ X B!^, we have 



-2-^ • ) Wa;)u - n{y)v) 

+ . + y)^dix) - d{y)) 

2A 

--^(d{x) - d{y)){n{x)u - n{y)v). 

Taking U = {u, u), as both d and n are Lipschitz continuous, and using Cauchy- 
Schwarz inequality we obtain straightforwardly the first inequality in (t^ii). The 
second inequality in {(pii) is clear. 

Let us now prove {4>iii). By symmetry, there is only one inequality to prove. 
Take x S dO and y £ O, and take U = {■y{x),0), and recall that j{x).n{x) > 
Co > 0. The sum of all the terms that have {d{x) — d(y)) = —d{y) can be made 

2(x — y) 

nonnegative for A large enough. The remaining term is, taking ^5 in 

factor, 

lix) - ^ip{^^)n{x) ■ 7(a;) = (^n{x) - fJ-pi^^)^ {n{x) ■ 7(0;)). 
Writing 

IM^) - < Mx) - + IM^) - <K\^\ + P, 

we have completed the proof of {(t)iii). 
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Finally, we set, for x,y G O, 
By choosing B, then C large enough, we obtain the desired result. o 

Appendix B. A deterministic reflection problem 

In this section, we suppose that b and a satisfy ([5]). We consider for each fixed 
a S L^{0, T; 1?™) and for each fixed {t, x) G [0, T]xO the deterministic equation 
with oblique reflection 

dY, ^ {b{s, Ys) - (7{s, Ys)a,) ds - dz^, Y^ G O, for aU s G [0, T] 
dzs = l9oiYshiYs)d\zl for all s G [0,r], (29) 
Yt = X and zt ~ 0. 

A solution of equation (p9)) is a couple (Y, z) of continuous functions defined on 
[0,T] with values in M"^ such that z has bounded variations, and \z\s denotes 
the total variation of z on the interval [0, s]. 

Theorem 5.2 Assume ^-^-^ and let a G L'^{0,T; R'^). Then, 

1. there exists a unique solution (y*^^-"^ 2*'^'") 0/ fi29jl . 

2. for each s G [0,r], the function {t,x) 1— > Y^*^^-" is continuous and 

- r/.-'."|2 < K{\x - xf + \t- 1'\^/^), 

3. for each (t,x) G [0,T] x O the function s i— >■ Y^'^'°' is Holder continuous 
and for each s, s' G [0, T], 

<K\s-s'\^/^, 

4- Assumption (A3) holds true, that is: for alla^^a G L^{0,T; IR'^), if a" 
a weakly in then - -> 

where the constant K in (2) and (3) depends only on O, 7, co i/ie Lipschitz 
constant Kt ofb, a and ||a||i2. 

Proof of (1) 

For the sake of completness, and as the hypothesis on the coefficient c = 6 — a a 
are slightly more general than in [31] or [5T], we present a complete proof. To 
that end, we use the Skorokhod problem. More precisely, fix (t, a;) G [0, T] x O, 
and a G L^{0,T; M'^) and define Cf(x) = b{t,x) — a{t,x)at for all {t,x) G 
[0, T] X O. 
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By [55], for each X S C{[t,T]; O), there exists at least one solution {Y, z) of 
the following Skorokhod problem: 

Ys=x + I Cu{Xu)du-Zs, Y eC{[t,T];0), 

* (30) 
ldo{Yuh{Yu)d\z\^, z e Cbv{[t,T];0). 



We next show that the solution of pop is unique and then we prove the exis- 
tence and uniqueness for the solutions of equation ((29)) by a fixed point argu- 
ment. Note that, in view of the first equation of (pO)) it is enough to prove the 
uniqueness for Y only. 

We define the binary relation S on C{[t,T]; O) in the following way: for all 
X,Y e C{[t,T];0), Y S X if and only if there exists z € Cbv i[t,T];0) such that 
(Y, z) is the solution of (|30| . 



Lemma 5.3 Let X,X',Y,Y' e C{[t,T];0) and suppose Y S X andY'SX'. 

Then, there exists rj > 0, depending only on O, 7, Cq and ax (and indepen- 
dent oft), such that for all u £ [t,t + v] ^ [0, , 

\y^~y:\<^\x^-x'j. 

Proof: We use the function V'e,p defined in Lemma 15.11 with £ = 1, and fix 
s e [t,T] and we put fx — Dxtpi.p, fy — -DyV'i.p- We have 

i^iAYsX)^i^iA^,^)+ I fx{Yu.Yi)cu{X^)du+ I fy{Y^X)cuiXi)du 



fAyu,Y:}loo{Yuh{Yu)d\z\^- / fy{Y^,Y;)lao{Y:h{Y:}d\z 



By (ipiii), the two last integrals of the right hand side of the above inequality 
are non positive. Write the first term of the right hand side of the previous 
inequality as 

{fx + fy){Yu,YMXu)du + ^ fy{YuX)icu{X'J - c„(X„))du. 

Put Ou ^ I + |a„|, by using (?/>«), (ipH) and as \cu{Xu)\ < Ka^ and \cu{Xu) - 
Cu{X'^)\<Ka^\X^,-X'J, 

\\Ys - < K (^2p2 + ^ (|y„ _ Yl\^ + p')a^du 

+ {\Y^-Y:,\+p')\X^-X'Ja.,du 



19 



This equality holds independently of p > and its right-hand term is nonde- 
creasing with s therefore, by letting p to we have for all s S [t,T], and writing 
for gGX, \g\[t^s] = snp{\g{u)\,u G [t,s]}, 

\Y - Y'\l^^ < K (^^' a^dv^ (\Y - r'lf,,,, + |F - Y%4X - . 

Now, by using Cauchy-Shwarz inequality, we have for \t — s\ small enough, 

\Y-Y%,< ^^l-^l-H^- \X-X%,^ 

and we can chose 77 > independently of t such that 

sup \y^-y:\<\ sup 

ue[t,t+?7]n[o,T] ^ ue[t,t+^]n[a,T] 

which completes the proof of the lemma. o 



Lemma 15.31 shows first that for each X there exists a unique Y such that 
XSY. Changing notation we have proved that 5 ; X i~> y is a map. Lemma 
15. 31 shows also that there exists r] such that for all t e [0, T], S contracts C{[t, t + 
rf\ n [0, T]; O) onto itself. This gives existence and uniqueness for (|29)) by a fixed 
point argument hence it proves assertion (1) of the theorem. 

Proof of (2) 

Let us first establish the following lemma. 

Lemma 5.4 Fix a,a' e L^{{),T;R'^) and t,t' e [0,T] with t' < t, x, x' eO 
and define Y ~ yt,^:,^ y' = y*^^ . Then, there exists a constant K > 
(which only depends on |ja||L2, cq, |i7||Lip, Kt and O) such that, for all p > 
and for all s € [t, T], we have 



K (^gp{s) + ^ gp{u) ■ (1 + + \a'J)du^ 



where 



gp{s)=p' + \x-x'\' + \t-t'\'/^- 



Dx'iJji^p{Yu,Y^)a{u,Yu){au - a'^)du 



Proof: We put for {s,y) G [0,T] x O, Cs{y) = b{s,y) - a{s,y)as, c'^{y) = 
b{s,y) — a{s,y)a'g, and = 1 + ja^l, a'^ — 1 + \a'J. Note that there exists 
a constant K such that for all (s, y) € [0,T] x O, one has |cs(y)| < Kas and 
|Cs(y)| < Ka'g. Define as before fx = Dxtpi^p and fy — Dyipi^p. Recall also 
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that the function tpi^p is a continuous function from IR'^ x M'^ to Ff^ which is 
bounded on O x O independently of p G (0, l)j and write 



+ {f. + fy){Yu,Yu)Cu{Xu}du 
+ I fy{YuXu){c'u{YL) - Cu{Yu))du 

f^{YuXndo{Yu)l{Yu)d\z\u 
fy{Y^M^doX)^X)d\z'U 



We then follow similar calculations as Lemma [ 

By Cauchy-Swharz inequality, the first integral can be majorated by K\t' — 
i|-'^/^||a'||L2, the second integral is smaller than K{p^{t — s) + \Yu — Y^\^audu). 
For the third integral write <(r^') - c„(r„) = b{u, K„) - 6(it, Y^) - {a{u, r„) - 
a{u, Y^J)a[^ + a{u, Yu){au — and we use (V'm); and eventually we use (ipiii) 
in order to estimate the to last integrals. Hence we have 



\Ys-Y:\^ < K{\x~x'\' + (t-t'y/^\\a'\\l,+p^) + K \Y^^Y:,\\^du 
+Kp\s - tY'^a'\\L2 +K \Yu - KPa:,du 
Dyipi^p{YuX) ■ cr[u,Yu){ctu - ct'^)du 



or equivalently 

\Ys - Y'f < Kgp{s) + K |K - y„f (1 + + K\)du 

for some positive constants Ci and C2. By Gronwall's lemma the proof is 
complete. o 

Fix a ^ and x,x' G O, and apply Lemma 15.41 to Y — y*-^-" and to 
Y' — y* '-^ We have, have gp{s) = p'^ + \x — x'p + \t — t'\^^^, which gives 
\Ys-Y^\'^ < K{p'^ + \x-x'\'^ + |t-t'|i/2). Letting p to 0, we have obtained the 
desired result. 

Fix So e [i,r] and a £ L^[0,T-R'^). Consider Y : s ^ Y,*'^'" and Y' : s ^ 

^ so 

Proof of (3) 

Let us first prove that for each {t, x) G [0, T] x O and for each s G [i, T\ one has 



sup -x\< Ky/iX~s. (31) 

jie[s,t] 
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Indeed, define Y and Y' by F„ = y„*'^'" and Y^ ^ x for u ^[t,T]. Put 
c{u,y) = b{u,y) — a{s,y)as and c'{u,y) — for (u^y) G [^,7"] x C The same 
computation as in Lemma gives, for all s' £ [t,s], 



'il^i,piYs',x) < J Dxil:i^p{Yu,x)c{u,Yu)du < j K\Yu - x\{l + \au\)du, 
which gives, using Cauchy-Shwarz inequality 



\Ys' -x\^ <K\ sup |i; - x\ ^/t~s (1 + ||a||L2(o.T)) ■ 

\ae[t,s] J 

Passing to the supremum over s' £ [t, s], we obtain sup \Yu — a;| < K^/t — s. 

ue[t,s] 

Fix now {t,x) e [0,T] x O and s,s' G [t,T], with s' < s. Put x' = Y^;'' . 
By the previous result we have |F/ — x'\ < K^/s — s', and by the uniqueness 
result we have the flow property Y^'^ — Yf , hence we have proved that 

Proof of (4) 

We apply Lemma lOl to Y — F*'^'" and F" — y*'^'"". Then is given for ah 
se[t,T] by 

where fp{t,y,y') — Dx^Ji,p{y,y')a{t,y) is continuous on [0,T] x x C 
We first prove that a subsequence of gp converges pointwise to as n goes 
to 00. We remark, by assertion (3) of Theorem 15.21 that the sequence (F") is 
bounded in C°'^/^([0, T]; O) and therefore is relatively compact. Let Y be one 
of its limit in X . Let us prove that this limit is Y . Extracting a subsequence if 
necessary, one can suppose that the sequence (y )p converges to Y. We write 



+ / fp{u,Yu,Yu) ■ {au - a':')du. 



The first integral converges to as p goes to oo by Lebesgue's Theorem and the 
second integral converges to by definition of the weak convergence of (a") to 
a. Now as (a") is bounded in L^{0,T; IR'^) there exists K > (independent of 
n and p) such that for all n G iV and for all s G [0, T], 

g;is)<p^ + K. 

It follows, applying again Lebesgue's Theorem in the inequality given by Lemma 
lOl that for aU p G (0, 1) and for aU s G (i, T), 



lim \Ys~Y:'-\^ <p\l+ r \au\du), 
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Letting p to 0, we deduce that {Y'^p)p converges pointwise, and even uniformly 
to Y and by uniqueness of the limit we have Y — Y . This implies that the whole 
sequence (i^")n converges uniformly to Y and the proof of (A3) is complete. 
The proof of Theorem 15.21 is now complete. o 

Appendix C: discontinuous mixed single or mul- 
tiple optimal stopping problems 

In this appendix we first study a mixed optimal control-optimal stopping time 
problem and we prove that a particular value function is the maximal viscosity 
supersolution of a variational inequality. Then we prove a reduction result: the 
value function of a mixed optimal control-optimal multiple stopping problem 
can be writen as the value function of a mixed optimal control-optimal single 
stopping problem with a new reward defined recursively. 



C.l. A deterministic mixed optimal control-optimal single 
stopping problem 

We first study the following mixed optimal control-optimal single stopping prob- 
lem. For each bounded borelian real valued function 'ip defined on [0, T] x O 
and for each {t,x) in [0,T] x O define the value function F[?/'](i,x) by 

Vmt.^)^ inf supU/ \as\''ds + i,{9X-"-n\ , (32) 



aeLm,T) e&[t,T] [2 7^ 

where F*'^'" is the unique solution of 

When %p is upper-semicontinuous (use), we show that this value function is 
caracterized as the maximal viscosity subsolution of the following equation 

+ i|(T^£)yp - 6 - Vj = in [0,T) X O 

IV * _ ^^^^ 

— = in [0,T) X do, ViT) = MT) on O 

The proof follows different results of Barles and Perthame [S] . We adapt them 
here to our context. 

Lemma 5.5 is use and V[ip^] is Isc. In particular, if ip is continuous, 

V[ip] is continuous. 

Proof: Step 1: Suppose, by contradiction, that ^^[t/'*] is not use. Then there 
exist {t,x) e [0, T] X O, a sequence (tn,x„)„ that converges to {t,x) and e > 
such that, 

V[iP*]{t,x) + 2e< lim l/[V'*](t„,x„). (34) 
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Now from the one hand there exists a such that for all G 

\ I' \asfds + riO, Y^'^^n < VirW, x) + e. (35) 
From the other hand for each n E IN there exists 6'„ £ [i„ , T] such that 

Extracting a sequence if necessary, we have that 6^ converges to 6* e [t^T]. By 
the regularity of Y given by Appendix B, we obtain that 

hm V[r]{tn,xr,) < I [' \as\'ds + r(eX-''n. (36) 
Now by (I2S1) with = and by ((M]) and dM]) we obtain 

^ J' \a,\^ds+riO,Y^^'''")+e <V[r]{t,x)+2e <^ J' ^ 

hence e < 0, which is the expected contradiction. 

Step 2: Suppose by contradiction that V'['0*] is not Isc. Then there exist 
(t,x) e [0, T] X O, a sequence {tmXn)n that converges to {t^x) and e > such 
that, 

V[il!^]{t,x)> lim F[V',](t„,x„) + 3£. (37) 
Note that for each n there exists a" G such that 

V[^P,]{t^,Xn)+e> sup 1 / |a^|2d5 + i/;,(0,y;'"""'"") (38) 



hence the sequence (a") is bounded in and extracting a subsequence if nec- 
essary, we can suppose that it converges to a weakly in . 

1 — — 

Now, as sup - / \as\'^ds + ^^{0,Yg"''^"°') > V[)p^]{t,x) there exists 9 G 
ee[t,T] 2 Jt 

[t, T] such that 



lasl'ds + M0,Yl'"'") + £ > y[AKt,x), (39) 



For each n £ IN define 6'„ = t„ A 0. One has 6'„ e [t„, T] and as i„ — t one has 
r^^. By dall) wehavet/[V'*](t„,a;„)+£ > " Kpds + 7/.*(6'„, F/;'^"'""). 
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Adding 2e and passing to the liminf we obtain, by continuity of Y and lower 
semicontinuity of ip* 

lim y[^,](t„,a;„)+3e> i / ja^pds + i^^'"'") + 2e. (40) 



2 „ „ 

Now by (I2S1), (EH) and (gHl) we obtain 

and the expected contradiction > e follows. o 



Lemma 5.6 (resp. V['>pf]) is a viscosity subsolution (resp. superso- 

lution) of fi33\) with obstacle ip. In particular, if tp is continuous, Vltp] is a 
continuous solution of Ii33\) with obstacle "0. 



For completness let us recall the definition of a viscosity subsolution and superso- 
lution of equation (|33|l . For simplicity we define H{D(p){t, x) = ^\a'^ D(p{t, x)f ~ b ■ 
D(p{t, x) 

Definition 1 An use locally bounded function v defined on [0, T] x O is a viscosity 
subsolution of equation if and only if 

\/(p G C"'"([0, r] X O), if {to,xo) G [0,r] X O is a local minimum ofv — ip, then 

1. if(to,xo)e[Q,T]xO, mm(^--^ + H{D^),v~r){to,xo)<0, 

2. if{to,xo)'^[Q,T\xdO, mm(^-^ + H{D,fi),v-^p*,^^{to,xo)<0. 

A Isc locally bounded function u defined on [0, T] x O is a viscosity supersolution 
of equation S33[) if and only if 

y^p G C^{[0, T] X O), if (to, a::o) G [0, T] x O is a local maximum of u — ip, then 

1. if{to,xo)e[0,T)xO, min(^-^ + //(D^),u- V.) (io,xo) > 0, 

2. if{to,xo)e{T}xO, v{to,xo) -i^,{to,xo)>0.. 

3. if{to,xo) G [0,r) X do, max (^mm{~^ + H (Dip), u - ^P,),^^ {to,xo) > 0, 

4. if {to,xo) e {T} X do, ma,^^u{to,xo) - rp,{to,XQ),^{to,xo)^ >0- 

Proof: Let us first recall the Dynamic Programming Principle, which proof is 
well known in the deterministic case, even for a discontinuous reward. 
For each {t, x) e [0, T] x O and for each r e [t, T] we have 



Vmt,^)= inf sup |i /' 



''V.l'rfs + ^(0,r/'^'")i{e<.} (41) 



+VmrX^^nMe>r}} . 
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Step 1: Let us first prove that is a viscosity subsolution. 

Let e C^([0,T] X O) and suppose that {tQ,xo) is a local maximum of 
V[il)*\ — 1^. Without loss of generality we can suppose that V[^*]{to,xo) = 
ifiito, Xo), and we fix r > such that for all {t, x) G [0,T] x O if \t — to\ < r and 
\x — xo\ <r then V['tp*]{t,x) < ip(t,x). 



If 



there is noth- 



V[^*]{tQ,XQ) < i)*ito,xo) or (a;o e dO and ^{to,xo) < o) 
ing to prove. Suppose that 

V[iP*](to,xo) > ^*ito,xo) and (if G dO then ^{to,xo) > o) 
Fix a € L'^{t,T;]RJ^) a constant control, and denote by ^ a real number 
in [to,T] which maximizes ^ /^'^ |apdu + ^e"'"""'") [*o,T']. One has 
ip{to,xo) = V[ij;*]{to,XQ) < i(^-io)|a|2 + and in particular, 

e > to. Consider also § = inf{s € \to,T], jr,*"'"^"'" - xo\ > r}. One has 9 > to- 
Fix T e (to!^"] such that r < min(0,0,to +?"). By the Dynamic Programming 
Principle one has i^(to, Xo) = '5^[V'1(to,aro) < i(r-io)|ap + V'[V'1(^, ^r"'"""") < 
^{T-to)\a\'^ + lp(t,Y^"-'"'-°'). Substractingy)(to,a;o), dividing by -h = to-r < 0, 
and letting to we obtain, for each a G JR™, 



- — (to,a;o) - -D</5(io,a;o) • 6(*o,a;o) - (^^l"! - Dip{to,xo) ■ (7{to,xo)a j < 0. 

If we chose a = {—Dip-a){tQ,xo) we obtain (^ ^ + H(Dip)^ (to, xq) < 0, hence 
we have proved that V[tp*] is a viscosity subsolution. 

5<ep 2: Let us prove now that ^ ['(/'*] is a viscosity supcrsolution. 

Let G C^([0,T] X O) and suppose that {to,xo) is a local minimum of 
V[tjj*] — (f. Without loss of generality we can suppose that V['tjj*]{to,xo) = 
ifiito, Xo), and fix r > such that for all {t,x) G [0,T]xO i{\t — to\ + \x — xo\ <r 
then V[tp*]{t,x) > (p{t,x). 

Clearly, if xo € dO and one has ^{to,xo) > there is nothing to prove. We 
suppose that, if xo € dO one has ^{to,xo) < 0. For each a € L'^{to,T) one 
has clearly, supg^j^^^ i /^^^ \as\'^ds + ip^{6,Yg°'''°'") > ip^,{to,Xo). Taking the 
infimum over a G L?{to,T) wc have V[ij)t,]{to,Xo) > il>*{to,Xo)- 
It remains to show that, if to ^ T then 

-^+H{D^){to,xo)>0. (42) 



V\tpJ(to,Xo) = inf max 



Fix T G {to,T]. The Dynamic Programming Principle gives 

1 f\ 
up - / |a 

to,-r) ^ Jto 

^^V.I'c«s + i/[V'*](r,r;«'-°'") 



sup - / \as\'ds + MW °' ) 
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hence 



V[i;*]{to,xo)> inf 

aeL^{to,T) 
I|a|lr2<-R' 



where K — V[tp*]{tQ, xq)- By the regularity of Y with respect to a and r, there 
exists h > such that for all a S L^{to, T) with < for all re [io, to + ^] 

one has |r - io| + IF^*"'^"'" - ^o| < Therefore, for each r G (to, to + h] we 
have 



(^(to,a;o) = ^['0*](*o,a;o) > inf 

QeL^(to,T) 



|a,pds + (p(r,y,*°'-»-«) 



(43) 



Suppose by contradiction that is not satisfied. Then, there exists e > 
such that ^{to, xq) + bDip{to, xq) — ^\a'^ D(p\'^{to, xq) > 2e. Taking r smaller if 
necessary, we can suppose that for all {t, x) e [0, T] x O, if |t — to| + |a; — xqI < r 
then 

^{t,x) + bDip{t,x) - ^\c7^Dip\^{t,x) > e. 

Changing the value of r if necessary, we can suppose in the case when xo G dO, 
that for all (i,x) G [0,r] x O, if \t - to| + \x - xo\ < r then ^(t,x) < 
and in the case when G O that if jx — xq] < r then x G C In both 
cases, if T G [to, to + h] then for all a G L?(to,T) with ||Q;||i2 < K we have 

iao(i;*'"^«'")|^(T,y,*«'-«'") <o. 

Noticing that inf — Dtpa{t,x)a = — [cr'^ Dip{t, x)]"^ , we have for 

T G (to, to + h], 
^(r,Y,to.^-«-'^)>^(to,xo)+ 



to 



Difib- D(p(ja){u,Y^°^'=°'°')du > ip{to,Xo) + 
£{t -h) ~ / \au\^du. Now (gS]) gives 

(/f (to, xo) > ip{to, xo) + s{t - to) > ip{to,xo). 
which provides the expected contradiction. o 

Lemma 5.7 Let {'tpn) be a nonincreasing sequence of continuous functions on 
[0,T] X O such that tjj* = lim ; Vn- Then V[ip*] = lim ; V[i'n]. 

Proof: Suppose that ■0„ I tfj* . Clearly, V[ipn] > Vii'*] and the sequence V[ipn] 
is nonincreasing hence we obtain < lim J, Let us prove the second 

inequality. Fix (t, x) G [0, T] x O, and s > 0. There exists a* G and 0* G [t, T] 
such that for all 6* G [t, T] one has 

V[r]it,x)+e>^l' |a:pd5+7A*(r,F,*f'"*) > i ^V:pds+^*(0,y,*'^'"*). 

(44) 
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Now, for each n E IN, there exists 0„ € [t, T] such that V[ipn] {t, x) < ^ J^" \al \'^ds+ 
4'ni9m Yg '^'"' ). Extracting a sequence if necessary, we can suppose that 0„ tends 
to 0. Fix p G IN. For each n > p, we have 

Letting n to oo, \iinn^ooV[')pn]{t,x) < | |a* pds+-0p(6', 1^'"^'" ). Now passing 
to the hmit in p and using (|44l) we obtain hm„^oo l^[V'n] {t, x) < V[ip*]{t, x) + e. 
o 

Proposition 5.8 is the maximal use viscosity suhsolution of fi3S\] with 

obstacle ip. 

Proof: In view of Lemmas 15.51 and 15. 6[ the only point which is left to show 
is the maximahty of the solution. Let w be a use function which is a viscosity 
subsolution of p3p with obstacle tjj. Let ipn be a nonincreasing sequence of 
continuous functions on [0, T]x O such that tp* = hm I tp^. Since > ^* , v is 
also a viscosity subsolution of equation ([55]) with obstacle '0" ■ By Lemma 15.61 
^["0"] is a continuous viscosity solution of the same equation, and v < V[ip'"] by 
Theorem [5?T0l As by Lemma [5Jl = hm l Vlipn], we obtain v < V[ip*]. 

o 



C.2. Reduction of multiple stopping to single stopping 
problems 

Let {tpi)i£]N be a family of real valued bounded measurable functions defined 
on [0, T] X O and consider for each nonempty finit subset I oi IN and for each 
{t, x) € [0, T] X O the mixed optimal control-optimal multiple stopping problem 

v\t,x)^ inf inf I \as?ds + Y^^^i^^X'"'")\ ■ (45) 

the value function of the following mixed optimal control-optimal single stop- 
ping problem 

u\t,x)^ inf f WA''ds + ^{eX'^^-)\, (46) 

where the new reward is defined recursively by 

{ ipi if / = {i} with i e iV, 

n + w^^^'^''^! if / contains 2 or more elements. ^^''•^ 



mm 
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Proposition 5.9 For each finit nonempty subset I of IN let be defined by 
and let he defined by and |^7[ j. Then for each {t,x) G [0,r] x O 
one has v-' {t, x) — {t, x). 

Proof: Fix a nonempty finit subset I of IN oi cardinal N. When / contains only 
one element, there is nothing to prove. Suppose now that / has two or more 
elments. Let us prove first that for each {t,x) G [0,T] x O, v^{t,x) < u\t,x). 
Fix {t, x) G [0, T] X O. Consider a partition {Aj)j^i of [t, T]^ such that for each 
9i e [t,T]^ if Oi e Aj then one has Oj = Ai^iOi. 

Fix a G L^{t,T) and Oi G [t,T]^ , 



Clearly, by uniqueness for equation ([7]) , the second terme of the right-hand side 
can be minorated by w^\'f-'^(6'j,yg'^'"), hence 



Hence (/) > u'{t,x). Taking the infimum over a G L'^{t,T) and 0i G [t,T]^, 
we obtain v'{t,x) > u'(t,x). 

Let us now prove the reverse inequality. For simplicity, suppose first that 
there exist an optimal time 6* G [t,T] and an optimal control a* G L'^{t,T) for 
u^{t, x), and for each i G / there exist <5" G L'^{d*,T) and 0" G [0*,T]^-'^ that 
are optimal for uAW(6»*,i;*f'"*). Define a" = a*l[t,e-)+&"l[e',T)- Note that 
a" is optimal for u^{t,x), that Ygf'" = Ygf'°' and that a" is also optimal 

for v'\^'\9*X'''"')- 

Let {Bi)i^i be a partition of [t,T] such that for each s G [i,T], if s G Bi 
then (?!)(s,i;*'=^'"*) = V'^Cs, i;*'"^'"*) + w^^-t'^s, F,*'^'"'). 

/■^* 

= \a*fds + (b{e*,Ylf'") 
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For each i define 61" G [i,T]^ by 6** = 6* and 6']* = ^j* for j e I\{i}. One has 
now 

In general, there is no optimal stopping control and stopping times, but for each 
e > on can find e/2 optimal 9* and a* for u^t,x) and e/2 optimal 9" and 

a'* for wA{*>(6'*, Yg*f '"'). Building a" and 6*" as above we obtain that for each 
e > 0, u^{t,x) + e > v^{t,x). o 

Appendix D: a strong comparison result 

In this appendix we prove a strong comparison result for viscosity solutions of a 
first order variational inequality with Neumann boundary conditions and with 
continuous obstacle. 

Theorem 5.10 Assume 0j and and let tp e C{[0,T] x 0;1R). If 

u, w : [0, r] X O — 5- JR are respectively use viscosity subsolution and Isc viscosity 
supersolution of 

( dw 1 \ 
min ( --^ + -j\(^'^Dw\'^ ~b- Dw,w-^pj ^0 m [0,T) x O, 

ow 

— = m [0,T) X do, w{T) = V'(r) on O, 

then u<v on [0,T] x O. 



Note that the difiiculty of proving this strong comparison result is double. 
First, we have to handle the Neuman condition, and the test function of Ap- 
pendix A was built to that aim. Second, even though the equation is of first 
order and no Ishii lemma is needed, the quadratic term \a'^Dv\'^ has to be taken 
with care. 

Proof: In the following we denote for all e > by the function defined by 
= Tp^e^ where '0e,p is the test- function of Lemma l5. II 
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Let u, V be respectively a bounded use viscosity subsolution and a bounded 
Isc viscosity supersolution of (|48p . We first remark that the terminal condition 
holds in a stronger sense that the viscosity sense. 

Proposition 5.11 For all x e O, u{T, x) < ipiT, x). 

Proof: Fix xq G O. For aU e > 0, put (peit, x) — ^e{x, xq) + and let (ij, Xj) 
be a global maximum of the use function u — ipe- Then u(T, xq) — ipeixQ, xq) < 

u{ts,Xe) — ipeixeiXfj) which implies, by Lemma [STTl ^ Xe'^ + ^-jr^ < 

^{te,Xe) < u(t^,Xe) — u{T,xo) + iPeiT,xo) < 2\\u\\ +Ke'^. We deduce that and 
Xe go respectively to T and xq as e goes to and, by the upper semicontinuity 
of u, that, 

lim u(t,, Xe) = u(T, xo) and lim = 0, lim = 0. (49) 

As, by Lemma lSTTI (i, a;) > if a; e dO, by definition of viscosity subsolution, 
one has, for all £ > and x^ £ O, 

min + i|(7^D2;(/9ep - b ■ D^ip^.u- ip^ {te,Xe) < 0. 

Now, assume that, for some subsequence, u{te,x^) > ip{t^,x^). Then, necessar- 
ily, for this subsequence, 

1 < e^\D,^,{x,,xo)\(}^\D^<i>,{x,,xo)\ + ll&ll). (50) 

But, by lemmalsn £\D^^ ^{xe~xo)\ < K{^-^^^^+£^) and therefore cannot 
occur because of ([49]) and for all e > 0, u{t^,x^) < tp{ts;,Xe). We conclude by 
letting e go to and using (|49l) . o 

For all < < 1 and all 5 > 0, let 

Mjx^a = sup {iyu{t,x) — v{t,x) — d{T — t)). 

(t,a;)G[0,T]xO 

Our aim is to prove that M^^^ < (1 — ^^)||V'II which will give the conclusion of 
the theorem by letting v and S tend to 1 and respectively. To do so, we define, 
for all £, a > 0, M^'^ as being the supremum over [0,T]2 x O of the function 

(t - s)2 

{t, s, X, y) iyu{t, x) - v{s, y) - 5{T - s) - *e(a;, y) — 

and denote by {t, s, x, y) an optimal point (recall that u and v are bounded and 
respectively use and Isc). 

We first notice that, since ^5(2;, x) = for all x £ dO, 

vu{T,x) - v{T,x) < M^'g 
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for all X € do, which implies by Lemma |5. II 

l\x-yf_ ^ ^ ^ ^j^j it -s? ^ 2(||u|| + ||„||) + Xe2_ ^^^^ 

Therefore, up to some subsequences, s and x, y converge respectively to some 
t and X in [0, T] x O as a and e go to 0. 

Now we proceed as in Propostion lS.llI For all a, £ > 

vu{t,x) -v{t,x)~6{T~t)- ^eC3:,x) < M'^'J, 

so that, by Lemma |5.1[ the upper semicontinuity of u and the lower semiconti- 
nuity of v, as a and e go to 0, 

\x-y\^ , {i-Sr 



> 0. (52) 

t" (ji- 

As a consequence, we get, as a and e tend to 0, 

K'J ^ ^^-.s- (53) 
We define, for ah {t,x), (s, y) e [0,T] x O, 

= i L(s,y) + 5(r-s) + *,(a;,y) + ^-^ 

|£-S|2 

f2{s,y) = M(t,£) - (5(T- s) - ^ — 

and we apply the definition of viscosity solutions to u and v: u — ipi reaches its 
maximum at (i, x) and when x G we can check easily that Dtpi (i, x) -7(0;) > 
by Lemma [5.1l and therefore the Neumann boundary condition never holds. This 
imply that for all a, £, 



lin (^-^ + ^\a^D^i\^ ~b-^uu-ib^ (i,i) <0. 



(54) 



For V, the situation is slightly different. As in the former case, we deduce from 
Lemma 15. f I that the Neumann boundary condition cannot hold when y £ dO, 
but if for some subsequence of {a,e), s = T then we can have v{s,y) > Tp{s,y) 
and no information on the partial differential inequation. In this case, we remark 
that i goes to T (hence t—T) and that, by Proposition 15.111 and the upper 
semicontinuity of u, for all (5o, u{i,x) < u(T,x) + 5o/2 < tp(T,x) + 5q/2 < 
ip(i,x) + So for a and e small enough. We deduce, from those two inequalities, 
by passing to the limit as a and £ go to and using (|53l) , that 



M^,5 = MT,x) - v{T,x) < iy'iJj{T,x) - ip{T,x) + (5o < (1 - + 
for all (5o > 0, so that finally M,j^s < (1 — 
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Now we are left with the case, when s < T at least along a subsequence of 
(e, a). We have 

^<^2 1| Tn |2 



+-\a'Dip,\'~b-ip2,v-iPj{.s,y)>0. (55) 

If, for some subsequence, u{i,x) > i^{i,x) then (|5i)) and ([55)1 give respec- 
tively 



and 



-^ii,x) + ^\aii,xfDipi{i,x)\^ - b{i,x) ■ ipi{i,x) < 
--^(s,?/) + -\a{s,y)'^Dip2{s,y)\'^ - b{s,y) ■ ip2{s,y) > 0. 



We multiply the first inequality by v and substract the second one ; we obtain a 
rather complicated inequality which has three kinds of terms; the time derivative 
term, the linear term and the quadratic term. 
The time derivative term is the simplest one 

The linear term can be writen 

(&(s, x) - b(i, x)) ■ D^-^,{x, y) + ib{s, y) - b{s, x)) ■ D^-^^ix, y) 
-b{s, y) ■ {D^-^,{x, y) + Dy-^,{x, y)) 

and can be estimated, if and denote respectively the modulus of continuity 
with respect to t and the Lipschitz constant with respect to a; of 6 on [0, T] x O 
and by using Lemma [531 by 



K [{u,{\t - s\) + K,\x y\) [^-^ + e'j + ||fe|| [^—^ + e 

We know, by ([ST|) . that |t — s| < Ca for some constant C independent of a and 
e < 1, therefore, if we choose 1 > e > ajb(Ca) as a and e go to 0, this linear 
term goes to by (l52t . 

As far as the quadratic term is concerned, we first remark that for all a, b in 
iR™ and all < < 1, 

V 1 — 1/ 

so that we are reduced to estimate 

\aii, xfD^^.ix, y) + a(s, yfDy^,{x, 

which we do as for the linear term, concluding that it goes to as a and e go 
to 0, providing that 1 > e > uJc{Ca.). 

In conclusion to all those estimates we obtain the contradiction (5 < 0, and 
finally we necessarily have, for all a and e > ajf,(Ca) small enough, u(t,x) < 
tlj{t,x). This, combined with ((55)) and (|53|) . yields M„^s < (1 ^ and the 

proof is complete, o 
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